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Abstract 

Objective: To evaluate the performance of Finnish Diabetes Risk Score (FINDRISC) in detecting undiagnosed diabetes and 
prediabetes among U.S. adults by gender and race. 

Methods: This cross-sectional analysis included participants (aged >20 years) from the National Health and Nutrition 
Examination Survey (NHANES) 1999-2010. Sensitivity, specificity, area under the receiver operating characteristic (ROC) 
curve and the optimal cutoff points for identifying undiagnosed diabetes and prediabetes were calculated for FINDRISC by 
gender and race/ethnicity. 

Results: Among the 20,633 adults (>20 years), 49.8% were women and 53.0% were non-Hispanic White. The prevalence of 
undiagnosed diabetes and prediabetes was 4.1% and 35.6%, respectively. FINDRISC was positively associated with the 
prevalence of diabetes (OR = 1.48 for 1 unit increase, p<0.001) and prediabetes (OR= 1.15 for 1 unit increase, p<0.001). The 
area under ROC for detecting undiagnosed diabetes was 0.75 for total population, 0.74 for men and 0.78 for women 
(p = 0.04); 0.76 for White, 0.76 for Black and 0.72 for Hispanics (p = 0.03 for White vs. Hispanics). The area under ROC for 
detecting prediabetes was 0.67 for total population, 0.66 for men and 0.70 for women (p<0.001); 0.68 for White, 0.67 for 
Black and 0.65 for Hispanics (p<0.001 for White vs. Hispanics). The optimal cutoff point was 10 (sensitivity = 0.75) for men 
and 12 (sensitivity = 0.72) for women for detecting undiagnosed diabetes; 9 (sensitivity = 0.61) for men and 10 
(sensitivity = 0.69) for women for detecting prediabetes. 

Conclusions: FINDRISC is a simple and non-invasive screening tool to identify individuals at high risk for diabetes in the U.S. 
adults. 
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Introduction 

Type 2 diabetes prevalence in the U.S. is increasing dramat- 
ically, with the age-adjusted prevalence of adults (aged 18 years or 
older) increased from 4.5% in 1995 to 8.2% in 2010 [1]. The 
economic cost of diabetes in the U.S., estimated by American 
Diabetes Association (ADA), was $255 billion in 2012, a 41% 
increase since 2007 [2]. Under the current diabetes incidence 
trend, it is projected that 1 in every 3 U.S. adults will have diabetes 
(diagnosed or undiagnosed diabetes) in 2050 [3]. Additionally, a 
relative high rate of undiagnosed diabetes has been identified in 
the U.S., accounting for about 27% of the total diabetes cases of all 
ages [1]. Also, in 2005-2008, 35% of U.S. adults (older than 20 
years) and 50% of those older than 65 years had prediabetes, a 
high risk stage of type 2 diabetes [4] . 



Emerging evidence from both observational studies and 
randomized controlled trials (RCTs) has clearly shown that people 
with high risk for type 2 diabetes or people at prediabetes stage will 
be benefited by early identification followed by the intensive 
lifestyle intervention and pharmacological treatment [5-9]. Thus, 
identifying those individuals becomes crucial and cost efficient. 
The traditional diabetes screening methods, including the fasting 
plasma glucose (FPG), the 2-hour oral glucose tolerance test 
(OGTT) or HbAlc test, are invasive, inconvenient and expensive 
[10,1 1]. This is also one of the important reasons why there are a 
large number of diabetic patients remaining undiagnosed. Seeking 
a simple, reliable and cost-effective diabetes screening method, 
such as a diabetes risk score that can be easily conducted in clinical 
or community setting, has been proposed by many investigators in 
many countries [12-23]. However, a recent research indicated 
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that diabetes risk scores derived from certain populations could 
have low validity when they were applied to the other populations 
[24] . Therefore, it is important to evaluate the performance of the 
diabetes risk score in a specific population before applying it in this 
population [24]. 

World-wide, more than 10 diabetes risk assessment tools have 
been developed from different populations [12-23]. Among them, 
Finnish Diabetes Risk Score (FINDRISC) is the most commonly 
used risk score in detecting undiagnosed diabetes. FINDRISC has 
multiple advantages over other diabetes risk scores. First, 
FINDRISC is a simple self-administered questionnaire which 
can be used as an initial diabetes screening in primary care or 
community settings. It can be well understood and easily 
calculated by the lay person or clinical personnel without any 
laboratory test. Second, FINDRISC was developed in a prospec- 
tive study with an excellent performance in predicting the 1 0-year 
incident diabetes in Finnish population [16]. Third, FINDRISC 
includes 8 clearly defined questions that cover all well known risk 
factors of diabetes. Last but not the least, FINDRISC has been 
evaluated in detecting individuals with undiagnosed diabetes and 
prediabetes in a cross-sectional study in Finland [25] and 15 other 
countries or regions and gained good validity in most of these 
populations [24,26-39]. However, most previous studies have 
been conducted in European countries with the majority of 
participants as Caucasians [26-32] or other single racial groups 
[24,33-39]. The performance of the FINDRISC in the U.S., a 
country with multiple racial/ ethnic groups, is still unknown. The 
aim of this study is to evaluate the performance of FINDRISC in 
identifying undiagnosed diabetes and prediabetes in U.S. popu- 
lation by sex and race/ethnicity. With the increase in the 
prevalence of type 2 diabetes and its associated economic burden 
in the U.S., identifying type 2 diabetes at early stage with simple 
and accurate methods becomes a public health priority. 

Methods 

Study Population (NHANES 1999-2010) 

The National Health and Nutrition Examination Survey 
(NHANES) is designed to assess the health and nutritional status 
of adults and children in the U.S. through surveys including 
national representative sample of non-institutionalized U.S. 
population. From 1999, the NHANES survey became a contin- 
uous program and data were collected every 2 years. The 
NHANES 2009-2010 is the most updated survey released for 
public and research. Details of the NHANES design and 
procedures are available at Center for Disease Control and 
Prevention (CDC) website [40]. In brief, NHANES 1999-2010 
includes 6 cross-sectional surveys (1999-2000, 2001-2002, 2003- 
2004, 2005-2006, 2007-2008, 2009-2010) that were based on a 
stratified multistage probability sampling design. Low-income 
persons, adolescents aged 12-19 years, persons aged 60 years or 
older, African Americans and Mexican Americans were over- 
sampled in NHANES surveys. Each survey included two 
components: a household interview and a health examination. 
The household interview included questionnaires on demographic, 
socioeconomic, dietary, and health-related information. The 
health examination component consisted of medical, dental, and 
physiological measurements, as well as laboratory tests adminis- 
tered by trained medical personnel in a fully equipped mobile 
examination center (MEC). 

For this study, we included all participants from NHANES 
1999-2010 aged 20 years or above who had complete information 
to calculate FINDRISC. The final sample size included in this 
analysis was 20,633. 



Finnish Diabetes Risk Score 

FINDRISC was originally developed to predict the 10 years 
diabetes incidence in Finnish population (35 to 64 years) in a 
cohort study [16]. The FINDRISC is calculated based on a simple 
questionnaire with 8 questions, including age (years), body mass 
index (BMI: kg/m 2 ), waist circumference (WC: cm), history of 
antihypertensive drug treatment, history of high blood glucose, 
family history of diabetes, daily consumption of fruits, berries, or 
vegetables (consume every day vs. not), and daily physical activity 
(having at least 30 minutes of physical activity during work or at 
leisure time vs. not) [16]. The questionnaire can be completed 
without any laboratory test. The answer of every question is 
assigned with different weighted scores according to the risk 
increase associated with the respective values in the regression 
model in the original cohort. The final score is the sum of the 
scores from 8 questions and ranges from 0 to 26 [25]. 

In our study, BMI and WC were identified from the 
anthropometric data measured by trained personnel in MEC. 
Daily physical activity time was calculated as the sum of the 
minutes spent on physical activity for commuting, recreation, and 
work on average for each day. The frequency of vegetables, fruits 
or berries consumption was initially collected through 24-hour 
food recall, and only those who consumed vegetables or fruits at 
least 100 grams/day were considered as consuming vegetables or 
fruits or berries every day. The answers to all the other questions 
of the FINDRISC were identified via self-reported answers from 
NHANES questionnaires. 

Diabetes and Prediabetes Definition and Measurement 

In the present study, we categorized individuals into different 
groups according to their self-reported diabetes status and 
laboratory test results. The criteria of lab diagnosed diabetes and 
prediabetes were based on the most updated ADA 2013 definitions 
[41]. Specifically, self-reported/diagnosed diabetes was defined as 
having answered "Yes" to the question "Other than during 
pregnancy, have you ever been told by a doctor or health 
professional that you have diabetes or sugar diabetes?". Undiag- 
nosed diabetes was defined as having HbAlc £6.5%, or FPG > 
1 26 mg/ dl, or 2-h OGTT plasma glucose & 200 mg/ dl, but not 
having self-reported diabetes. Diabetes included individuals either 
in the self-reported/diagnosed diabetes category or in the 
undiagnosed diabetes category. Prediabetes was defined as not 
having diagnosed or undiagnosed diabetes, but having HbAlc 
between 5.7 and 6.4%, or FPG between 100 and 125 mg/dl, or 2- 
h OGTT plasma glucose between 140 and 199 mg/dl. Normal 
glycemic level included individuals who did not have self-reported 
diabetes and did not meet the diabetes and prediabetes diagnosis 
criteria according to the FPG, 2-h OGTT, and/or HbAlc values. 

Statistical Analysis 

Primary Analyses. Descriptive data on study participants' 
characteristics were expressed as means ± standard deviations 
(SD) for continuous variables and percentage for categorical 
variables. Student's t-test and % 2 test were applied to compare 
continuous and categorical variables, respectively. These proce- 
dures allow users to specify primary sampling units, stratification 
identification and sampling weights in the statistical procedures, as 
well as to generate design-adjusted means, percentages, standard 
errors (SE) and regression coefficients (fi). Unadjusted and adjusted 
logistic regressions were performed to estimate the association of 
FINDRISC with diabetes, undiagnosed diabetes, and prediabetes, 
separately, where the smoking status (never, former, vs. current 
smoker), current alcohol drinking (yes vs. no), highest education 
level (with vs. without college degree or above), annual household 



PLOS ONE | www.plosone.org 



2 



May 2014 | Volume 9 | Issue 5 | e97865 



Evaluation of Finnish Diabetes Risk Score in U.S. 



income (more than vs. less than annual household income of 
$45,000) have been controlled in the adjusted analyses. Sensitivity, 
specificity, positive (PV+) and negative (PV-) predictive values 
were calculated for each FIND RISC score from 5 to 1 5 points for 
detecting undiagnosed diabetes (individuals with self-reported 
diabetes were excluded from this analysis) and prediabetes 
(individuals with self-reported or undiagnosed diabetes were 
excluded from this analysis). Gender- and race-specific receiver 
operating characteristic (ROC) curves were constructed to visually 
show the relationship between true-positive (sensitivity) and false 
positive (1 -specificity). The area under the curve (AUC) was used 
to evaluate the performance of FIND RISC in detecting undiag- 
nosed diabetes and prediabetes. An AUC = 0.5 indicated the test 
performed no better than chance and AUC = 1 .0 indicated perfect 
discrimination. The optimal cutoff points were determined by the 
point with the shortest distance in the ROC curve which was 
calculated as the square root of [(1 -sensitivity) 2 + (1- specificity) 2 ] 
[42]. All the statistical analyses were performed using SAS 
software, version 9.3 (SAS Institute, Cary, NC). 

Secondary Analyses. Our secondary analyses were aimed to 
1) compare FIND RISC with another diabetes risk score developed 
among Americans [12]; 2) conduct a stratified analysis by age 
(<65 vs. £65 years of age); and 3) conduct a sensitivity analysis 
among a subgroup of individuals who had all results of FPG, 
OGTT and HbAlc. 

Results 

A total of 20,633 adults aged >20 years (mean: 47.5±17.8 
years) were included in this analysis. Characteristics of participants 
according to the FINDRISC group were presented in Table 1. 
Around half of the population were women (49.79%), non- 
Hispanic White (52.97%), having household income less than 
$45,000/year (51.16%), currendy married (56.42%) and having 
college degree or above (51.51%). The majority of the population 
were current alcohol drinkers (72.58%) but were non-smokers 
(78.47%). Among all participants of NHANES 1999-2010, the 
weighted percentage of self-reported/diagnosed diabetes, undiag- 
nosed diabetes and prediabetes were 10.47%, 4.14% and 35.55%, 
respectively. Age, female percentage, percentage of annual 
household income below $45,000, percentage of married status, 
BMI, waist circumference, FPG, HbAlc, and systolic blood 
pressure increased with greater FINDRISC score (for each, P< 
0.0001). 

Figure 1 shows the prevalence of diabetes (both self-reported 
and undiagnosed diabetes, N = 20,633) and prediabetes (self- 
reported/diagnosed and undiagnosed diabetes excluded, 
N = 18,113) by gender and race /ethnicity across the six FIN- 
DRISC groups (0-3, 4-6, 7-10, 11-14, 15-19, and 20-26). The 
FINDRISC was positively associated with the presence of diabetes 
and prediabetes in all the gender and racial/ ethnic groups: peaked 
in the highest FINDRISC score group (20-26 points). The 
prevalence of diabetes increased from 0.83% to 93.99% for men 
and from 0.44% to 90.27% for women in the lowest FINDRISC 
group (0-3 points) compared to the highest FINDRISC group 
(20-26 points) (Figure 1A). The same increasing trend was 
identified by racial/ethnic group. In the highest FINDRISC 
group (20-26 points), the prevalence of diabetes was 89.63% 
among non-Hispanic White, 92.95% among non-Hispanic Black 
and 93.77% among Hispanics (Figure IB). The prevalence of 
undiagnosed diabetes (N = 18,879) was also found to be positively 
associated with FINDRISC after excluding the diagnosed 
diabetes, with 28.57% for men, 18.97% for women, 22.00% for 
non-Hispanic White, 29.17% for non-Hispanic Black, 15.79% for 



Hispanics in the highest FINDRISC group (20-26 points) (data 
not shown). After excluding all diabetic patients, the prevalence of 
prediabetes also peaked in the highest FINDRISC group (20-26 
points): 88.00% for men, 59.57% for women, 64.10% for non- 
Hispanic White, 82.35% for non-Hispanic Black, and 68.75% for 
Hispanics (Figure 1 C and D). Despite of the same positive 
association trend for the 3 diabetic categories with FINDRISC, 
there were gender and racial/ethnic differences in terms of the 
distribution of the prevalence. Men had higher prevalence of 
diabetes, undiagnosed diabetes and prediabetes than women in all 
the FINDRISC score groups. Hispanics had a higher prevalence 
of diabetes while Non-Hispanic Black had a higher prevalence of 
undiagnosed diabetes and prediabetes over the other racial/ethnic 
groups. 

Results from the logistic regressions also showed significant 
associations of FINDRISC with all diabetes, undiagnosed diabetes 
and prediabetes. One unit increase in FINDRISC was associated 
with a 48.2% (95% CI: 46.0%, 50.5%) increased odds of having 
diabetes, a 22.3% (95% CI: 20.0%, 24.7%) increased odds of 
having undiagnosed diabetes and a 14.9% (95% CI: 14.0%, 
15.8%) increased odds of having prediabetes after adjusting for the 
smoking status, alcohol drinking, highest education level, and the 
annual household income (data not shown). There was no 
interaction between gender and FINDRISC score, indicating the 
associations between FINDRISC and the prevalence of diabetes, 
undiagnosed diabetes or prediabetes were similar comparing men 
with women. 

As shown in Table 2, the sensitivity of FINDRISC for 
identifying undiagnosed diabetes and prediabetes decreased as 
the specificity increased in both men and women. At the cutoff 
value of 10 in men (sensitivity = 74.68%; specificity = 62.74%) and 
12 in women (sensitivity =72.17%; specificity =68.60%), the 
distance in ROC was the shortest for undiagnosed diabetes (0.45 
in men and 0.42 in women). Accordingly, using the optimal cutoff 
point of FINDRISC of 9 in men (sensitivity =60.94%; specificity 
= 62.43%) and 10 in women (sensitivity =68.72%; specifici- 
ty =60.89%) resulted in the shortest distance in ROC for 
prediabetes (0.54 in men and 0.50 in women). We also evaluated 
the racial/ethnic specific optimal cutoff points for both undiag- 
nosed diabetes and prediabetes (data not shown). We found that 
the best cutoff point for undiagnosed diabetes was 1 1 for non- 
Hispanic White (sensitivity = 74.93%), 12 for non-Hispanic Black 
(sensitivity = 7 1.25%), and 11 for Hispanics (sensitivity = 65.98%). 
The optimal cutoff point for prediabetes was 10 for each race/ 
ethnicity, but with the highest sensitivity for non-Hispanic Black 
(62.42%) and the lowest sensitivity for Hispanics (55.88%). By 
combining all men and women, the optimal cutoff point for 
undiagnosed diabetes was 11 (sensitivity = 72.13%; specifici- 
ty =65.48%); for prediabetes, the optimal cutoff point was 10 
(sensitivity = 59.34%; specificity = 65.43%) in this U.S. population 
(data not shown). 

The area under the ROC curve for identifying undiagnosed 
diabetes were 0.74 in men and 0.78 in women (p<0.001); 0.76 for 
White, 0.76 for Black and 0.72 for Hispanics (p = 0.03 for White 
vs. Hispanics) (Figure 2 A and B). Whereas for identifying 
prediabetes, the area under the ROC curve was 0.66 for men and 
0.70 for women (p<0.001); 0.68 for White, 0.67 for Black and 
0.65 for Hispanics (p<0.001 for White vs. Hispanics) (Figure 2 C 
and D). After combining all the men and women participants, the 
area under the ROC curve was 0.75 for identifying undiagnosed 
diabetes and 0.67 for identifying prediabetes. 

We performed stratified analysis by age (<65 vs. &65 years of 
age, men and women combined) because the original FINDRISC 
was developed in a population with age younger than 65 years 
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Table 1. Characteristics of the participants aged 20 years or above in NHANES 1999-2010, by FINDRISC group* 





Characteristics 


FINDRISC Group 








P 


All Participants 




1 st 




3rd 


4 th 


5 .h 






FINDRISC value 


Mean (SD) 


3.33 (2.05) 


8.91 (1.43) 


12.86 (0.83) 


16.87 (1.63) 


22.49 (1 .38) 


<.0001 


9.49 (5.37) 


Median (range) 


4 (0-6) 


9 (7-11) 


13 (12-14) 


17 (15-20) 


22 (21-26) 




9 (0-26) 


N 


6,126 


7,311 


3,687 


2,845 


664 




20,633 


Age, year 


36.98 (14.28) 


47.49 (1 7.45) 


51.85 (17.17) 


60.62 (13.20) 


63.90 (10.11) 


<.0001 


47.49 (17.81) 


Female, % 


42.87 


51.18 


54.62 


53.99 


53.46 


<.0001 


49.79 


Race/Ethnicity, % 


Non-Hispanic White 


54.05 


55.41 


51.59 


48.86 


41.57 


-e.oooi 


52.97 


Non-Hispanic Black 


16.68 


16.00 


19.88 


22.07 


27.56 




18.11 


Hispanics 


23.84 


24.93 


25.14 


26.12 


27.71 




24.90 


Other 1 


5.44 


3.65 


3.39 


2.95 


3.16 




4.02 


Annual household income, % 


Above $45,000/year 


51.34 


48.60 


43.40 


37.49 


32.38 


<.0001 


46.42 


Below $45,000/year 


46.21 


48.90 


54.19 


60.49 


64.44 




51.16 


Other* 


2.45 


2.50 


2.40 


2.02 


3.17 




2.42 


Marriage status (married), % 


49.98 


59.37 


58.68 


58.90 


60.06 


<.0001 


56.42 


Education (have college degree 
or above), % 


57.03 


52.81 


49.93 


41.51 


37.66 


<.0001 


51.51 


Current smoking (yes), % 


27.39 


20.76 


19.27 


16.03 


12.20 


<.0001 


21.53 


Current alcohol intake (yes), % 


78.55 


74.14 


68.17 


65.03 


58.58 


-C.0001 


72.58 


BMI, kg/m 2 


23.68 (3.05) 


28.76 (5.62) 


31.47 (6.06) 


32.47 (6.00) 


33.65 (6.09) 


<.0001 


28.41 (6.18) 


Waist circumference, cm 


84.36 (8.95) 


98.81 (13.16) 


105.24 (13.41) 


108.51 (13.10) 


112.35 (13.00) 


-C.0001 


97.44 (15.25) 


FPG S , mg/dl 


93.86 (14.40) 


99.31 (21.41) 


106.25 (30.00) 


126.26 (51.97) 


161.15 (69.65) 


<.0001 


104.75 (33.66) 


HbAlc, % 


5.20 (0.41) 


5.41 (0.64) 


5.65 (0.89) 


6.30 (1.47) 


7.33 (1.60) 


<.0001 


5.58 (0.97) 


Systolic BP 


115.81 (14.89) 


122.77 (18.21) 


126.46 (18.61) 


132.65 (20.23) 


133.39 (20.93) 


<.0001 


123.07 (18.70) 


Diastolic BP 


68.79 (11.55) 


70.65 (13.10) 


71.55 (13.59) 


70.91 (14.81) 


67.35 (15.20) 


<.0001 


70.19 (13.13) 


Diabetes, % 


unweighted 


0.93 


4.17 


11.09 


39.30 


99.10 


-C.OOOl 


12.34 


Weighted 


1.05 


4.54 


11.01 


39.33 


98.27 




10.47 


Undiagnosed diabetes, % 


Unweighted 


0.85 


3.31 


6.54 


9.00 


0.30 


-e.oooi 


3.84 


Weighted 


0.97 


3.61 


7.35 


11.03 


0.27 




4.14 


Prediabetes, % 


Unweighted 


16.59 


28.70 


36.94 


33.74 


0.60 


-C.OOOl 


26.37 


Weighted 


24.22 


39.76 


48.73 


42.07 


1.73 




35.55 



Data are means (SD) except where noted otherwise. 

•FINDRISC group: = 1 if score<7, = 2 if score 7-11, =3 if score 1 2-1 4, = 4 if score 1 5-20, = 5 if score >20; 
+ Other race, including multiracial; 

"'"The participants select the annual household income as over $20,000; 

5 Fasting plasma glucose. 

doi:1 0.1 371 /journal.pone.0097865.t001 



(data not shown). For undiagnosed diabetes, the area under the 
ROC curve was 0.75 for all individuals, 0.75 for participants 
younger than 65 years (N = 1 7,072), and 0.65 for participants aged 
65 years or above (N = 3,561). The sensitivity (cutoff point = 10) 
was 75.27% for participants younger than 65 years and 87.04% 
for participants aged 65 years or above. For prediabetes, the area 
under the ROC curve was 0.67 for all individuals, 0.66 for 
participants younger than 65 years, and 0.57 for participants aged 
65 years or above. The sensitivity (cutoff point =9) was 61.40% 



for participants younger than 65 years and 82.98% for participants 
aged 65 years or above. 

Discussion 

In this large, cross-sectional study of national representative 
sample of free-living adults in the U.S., we found that the 
FINDRISC had good performance in identifying undiagnosed 
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Prevalence of Diabetes by FINDRISC 



Prevalence of Diabetes by FINDRISC 



100 
90 
80 
70 
60 
50 
40 
30 
20 
10 
0 




7-10 11-14 
FINDRISC 



Prevalence of Prediabetes by FINDRISC 




7-10 11-14 
FINDRISC 




Non-Hispanic White 
i Non-Hispanic Black 



I Hispanics 



0-3 4-6 7-10 11-14 15-19 20-26 
FINDRISC 

Prevalence of Prediabetes by FINDRISC 




Non-Hispanic White 
i Non-Hispanic Black 
I Hispanics 



7-10 11-14 15-19 20-26 
FINDRISC 



Figure 1. Prevalence of diabetes (A and B) and prediabetes (C and D) by Finnish Diabetes Risk Score (FINDRISC) by gender and 
race/ethnicity, in US men and women aged 20 years or above, NHANES 1999-2010. The prevalence of diabetes (including diagnosed and 
undiagnosed diabetes) was calculated among all participants; the prevalence of prediabetes was calculated among participants excluding the 
diagnosed and undiagnosed diabetes. 
doi:1 0.1 371 /journal.pone.0097865.g001 



diabetes and prediabetes in both men and women in all racial/ 
ethnic groups. 

Type 2 diabetes usually starts from increased insulin resistance, 
a disorder that cells cannot respond to insulin normally and the 
pancreas gradually loses its ability to generate enough insulin. Two 
population-based studies have confirmed that the FINDRISC is 
associated with insulin resistance [43,44], which supports the use 
of FINDRISC in detecting type 2 diabetes from the biological 
aspect. 

The current ADA guideline for type 2 diabetes screening among 
asymptomatic population is based on the laboratory testing [45]. 
However, there is always a trade-off between simplicity and 
accuracy for each screening method. Thus, using a simple and 
valid questionnaire as a preliminary screening method followed 
with more invasive and accurate diagnosis in primary care and/ or 
community settings, can be a cost-effective and practical method. 
FINDRISC is such a simple and non-invasive diabetes risk score 
which can be well understood by lay people and easily calculated 
by the lay people or clinical personnel without any laboratory test. 
It has been evaluated and performed well in many European 
countries [26-32]. To our knowledge, this study is the first study to 
validate the FINDRISC in national representative population in 
U.S.. As we expected, FINDRISC had a good validity in detecting 
undiagnosed diabetes and prediabetes in the U.S. adults. The 
areas under ROC curve for detecting undiagnosed diabetes were 
0.74 in men and 0.78 in women in the U.S., which were very 
similar with those in other European populations. FINDRISC can 
also be used to detect prediabetes with the areas under ROC curve 
of 0.66 for men and 0.70 for women. 

A risk score for undiagnosed diabetes using the data of 
NHANES 1999-2004 was developed by Bang et al. in 2009 
[12]. This risk score (NHANES DRS) is calculated out of 6 



variables, including age, sex, family history of diabetes, personal 
history of hypertension, obesity, and physical activity. Although 
NHANES DRS is comprised of readily available health informa- 
tion without using any laboratory test results and is originated 
among Americans, it was constructed from a crosssectional 
dataset. The definition of diabetes used in developing this risk 
score was only based on the fasting plasma glucose value, ignoring 
the OGTT or HbAlc value. In addition, NHANES DRS does not 
use any information on dietary intake which is well known to play 
an important role in diabetes development. However, as the 
NHANES DRS was developed from U.S. populations, it could be 
informative to compare FINDRISC and NHANES DRS using the 
current dataset. For undiagnosed diabetes, the area under the 
ROC curve of NHANES DRS was 0.77 (vs. 0.75 of FINDRISC) 
in all individuals, 0.76 (vs. 0.74 of FINDRISC) in men, and 0.78 in 
women (vs. 0.78 of FINDRISC). Although NHANES DRS has the 
advantage of being generated using NHANES data, the 
FINDRISC has very similar discriminating ability as compared 
to NHANES DRS from our results. 

Compared with previous evaluation of FINDRISC in European 
populations, the most difference of this study is the composition of 
the study participants, the sample size and the diabetes diagnosis 
criteria. For every previous evaluation in Europe, the study 
population was all middle aged or old participants or patients with 
one or more cardiovascular disease risk. However, the participants 
of our study are nationally representative U.S. adults aged 20 years 
or older, which indicates the FINDRISC performs well not only in 
high risk population but also in the general free-living population. 
Although our stratified analysis indicated that the discriminating 
ability of FINDRISC is lower in people aged 65 years or above, 
the sensitivity was 87.04% for undiagnosed diabetes and 82.98% 
for prediabetes, which is acceptable for a first line screening tool. 
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ROC for Undiagnosed Diabetes By Race/Ethnicity 
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Figure 2. Receiver operating characteristic (ROC) curve for identifying undiagnosed diabetes (A and B) and prediabetes (C and D) 
by gender and race/ethnicity in US men and women aged 20 years or above, NHANES 1999-2010. 

doi:1 0.1 371 /journal.pone.0097865.g002 



Thus, FINDRISC can work as an initial screening tool at the 
community or population level for American adults aged 20 or 
above, for Whites, Blacks, and Hispanics. The large sample size is 
also the strength of our study, which can produce more reliable 
results. Combined with the multiple racial/ ethnic feature of our 
study population, this allows us to evaluate the validity of 
FINDRISC in different gender and racial/ethnic strata. 

Using ADA diabetes diagnosis criteria 2013 to validate 
FINDRISC for the first time is another strength of our study. 
Compared with WHO diabetes diagnosis criteria or only FPG 
value used in previous studies of FINDRISC evaluation among 
other populations, our study added HbAlc as a diagnosis criterion. 
As a more convenient screening method than FPG and OGTT, 
HbAlc test does not require fasting and is not influenced by the 
day to day variation. HbAlc has also been found to have a very 
high specificity in identifying diabetic patients in different racial/ 
ethnic groups [46,47]. Thus, including HbAlc as diagnosis criteria 
for both diabetes and prediabetes leads to reducing the false 
negative results in our study. 

Another improvement in the present study is investigating the 
gender and racial/ethnic difference in the performance of 
FINDRISC with a single population, as well as identifying the 
optimal cutoff point for each subgroup. Only in a cross-sectional 
evaluation of FINDRISC in Finland, FINDRISC was evaluated 
for different performance in detecting undiagnosed diabetes, 
abnormal glucose tolerance and metabolic syndrome by gender. 
FINDRISC was identified as performing a little better in women 
than in men only in distinguishing the metabolic syndrome 
without statistical significance [25]. However, in the current study 
among U.S. general population, FINDRISC performs significandy 



better in women than in men in detecting both undiagnosed 
diabetes and prediabetes. No previous study compared the 
performance of FINDRISC by race /ethnicity. In the present 
study we found the FINDRISC performed significantly better in 
non-Hispanic White than in Hispanics. The difference in the 
performance by gender or race/ethnicity could be due to the 
different sensitivity of the question by gender and race/ ethnicity, 
such as BMI and waist circumference. One study has found that 
central obesity is more related with non-insulin-dependent 
diabetes mellitus in women than in men [48], and another study 
has shown that waist circumference has lower impact in metabolic 
syndrome in Hispanics than in non-Hispanic White and non- 
Hispanic Black [49]. The different performance in each subgroup 
even supports the rationality of evaluation of FINDRISC before 
applying it to a specific population. However, despite of the 
different performance, our results still indicate FINDRISC is a 
reliable screening tool in the general U.S. population. The 
different optimal cutoff points identified in the study could be 
applied to each subgroup in the practical application. 

One limitation of our study is that we cannot evaluate the 
FINDRISC in predicting the future incident diabetes because the 
NHANES is a cross-sectional survey which did not provide follow- 
up data. However, FINDRISC was developed for both predicting 
future diabetes and detecting undiagnosed diabetes [16]. In 
addition, detecting the prediabetes in the general population also 
identifies the population at higher risk of type 2 diabetes in the 
future, given the continuum of the risk for diabetes [50] . Another 
limitation of current study is the possibility of misclassification on 
diagnosis of diabetes and prediabetes because not all participants 
have results from all 3 tests (i.e. FPG, OGTT, and HbAlC). To 
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evaluate the impact of this limitation on our results, we conducted 
a sensitivity analysis among individuals who had results from all 3 
tests (N = 3,978). The results showed that among this subgroup of 
individuals who had 3 tests results, the area under the ROC curve 
was 0.71 (vs. 0.75 for all individuals) for undiagnosed diabetes and 
0.67 (vs. 0.67 for all individuals) for prediabetes, indicating the 
influence of the possible misclassification is minor. 

Our evaluation was based on a relative healthy adult 
population. Different cutoff values may be applied for other 
populations such as children and adolescents and obese people. 
Further research is warrantied to investigate whether the cutoffs of 
FINDRISG suggested by this study could be applied to some other 
specific youth and obese populations given the increased 
prevalence of obesity and type 2 diabetes in children and 
adolescents in the U.S.. 
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